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ABSTRACT 


This study investigates whether undergraduates were able to take collective responsibility to gradually improve 
community knowledge. The participants were 30 undergraduates from 24 majors in a key normal university. The analysis 
of their online Knowledge Forum writing indicated that the undergraduates were aware of peers’ contributions, made 
complementary contributions, and showed distributed engagement, and thus they could take collective cognitive 
responsibility. The results also showed that students gradually improved community ideas. This study has implications 
for teachers who aim to design technology-enhanced learning environments to engage students. 
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1. INTRODUCTION 


Collaborative inquiry, a major research strand in education, can help students develop higher-level 
competencies such as inquiry, collaboration, knowledge creation, agency and metacognition. Productive 
collaborative inquiry requires participants to collectively take cognitive responsibility (Zhang, Scardamalia, 
Reeve, & Messina, 2009). However, facilitating students to collectively and sustainably take this 
responsibility and thus advance collective ideas instead of solely completing tasks is challenging. Collective 
cognitive responsibility includes the three dimensions of awareness of contributions, complementary 
contributions, and distributed engagement (Zhang et al., 2009). 

Knowledge building is a collaborative-inquiry model, and considers the process of knowledge creation to 
be a social process (Scardamalia & Bereiter, 2006). It refers to “collective cognitive responsibility for idea 
improvement” (Scardamalia & Bereiter, 2006). In most knowledge-building implementations, the 
Knowledge Forum is used to promote and sustain the knowledge-building discourse. Research has suggested 
that students tend to sharing rather than create knowledge, which can be due to low-level collective cognitive 
knowledge resulting from a lack of an appropriate knowledge-building environment. 

By recognizing the challenges and the requirements, a knowledge-building environment to help students 
take collective cognitive responsibility was designed in this study. The study aims to examine whether 
undergraduates were capable of taking collective responsibility to improve their knowledge-building 
discourse. This study is part of a larger project that focused on developing students higher-order 
competencies through knowledge-building environment augmented by learning analytics. The study aimed to 
answer the following two research questions. 

(1) What are the characteristics of undergraduates’ collective cognitive responsibility in the 
knowledge-building process? 

(2) To what extent do undergraduates gradually take collective cognitive responsibility to advance 
community knowledge? 
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2. METHODS 


2.1 Research Context and Participants 


The participants were 30 undergraduates from 24 disciplines in a key university that focused on preparing 
primary and secondary school teachers. They participated in the study for 4 months while taking a core 
course of literal education for 1.5 hours each week. The course is aimed at helping undergraduates deploy 
and develop skills in the process of inquiry and creating knowledge. Most students had low levels of 
motivation and limited skills of collaboration and inquiry in the initial stage, and they took this course to gain 
academic points for graduation. The course teacher had one year of teaching experience, had received her 
doctoral degree in information technology studies, and had expertise in knowledge-building pedagogy. 


2.2 Pedagogical Design 


The teacher used a three-phase knowledge-building model to help undergraduates familiarize themselves 
with knowledge building and to gradually take collective cognitive responsibility for idea improvement. The 
phases were to develop an awareness of their contributions and their skills of inquiry and collaboration 
through small-group design activities (e.g., making bridges using newspapers and posters) (Phase 1); to 
provide complementary contributions through question-oriented, idea-centered inquiry discourse on the 
Knowledge Forum (Phase 2); and to promote collective responsibility through reflecting on data indicating 
their participation, collaboration, and contributions (Phase 3). 


3. DATA ANALYSIS AND RESULTS 


Knowledge Forum writing was the primary data source. Our argument was that if students gradually assumed 
a higher level of collective responsibility they could generate productive Knowledge Forum discourse. The 
online discourse was pre-processed based on thematic analysis and then organized into inquiry threads. An 
inquiry thread is a sequence of notes that aim to address one principal problem (Zhang, Scardamalia, Lamon, 
Messina, & Reeve, 2007). The goal of analyzing the inquiry threads was to obtain a holistic understanding of 
the students’ ideas and provide a context for the subsequent analysis of the characteristics of cognitive 
collective responsibility. In total, 38 inquiry threads including 612 notes were developed. 

Next, we conducted content analysis to analyze and characterize undergraduates’ collective responsibility 
using the inquiry thread as the unit of analysis. We used the coding framework that was adapted from our 
previous research (Yang, van Aalst, Chan, & Tian, 2016) to code the notes in each inquiry thread. Two raters 
independently coded the notes from three inquiry threads in the experimental class (n = 190, 30%). The 
inter-rater reliability was .78 for awareness of contributions, .79 for complementary contributions, and .78 for 
the wide-ranging complexity of questions and ideas (Cohen’s kappas). 


3.1 Characterization of Collective Cognitive Responsibility 


We selected 14 large inquiry threads for content analysis, which were defined as threads that included more 
than 15 notes. The coding results are given in Table 1. 

Awareness of contribution and complementary contributions. Table 1 shows that students contributed a 
considerable number of notes to create shared understanding (70) and to negotiating a fit (119). The results 
suggest that undergraduate became aware of the emergent issues and others’ ideas by reading notes on shared 
understanding and further negotiating a fit, and therefore were aware of peers’ contributions. Table | also 
shows that students made complementary contributions through participating in problem-centered discourse 
(62 notes), regulating their inquiry (22), and synthesizing community ideas to attain a higher level (38). 

Distributed engagement. To reveal students’ distributed engagement, we used the Knowledge Building 
Discourse Explorer (KBDex, Oshima, Oshima, & Matsuzawa, 2012), a socio-semantic network analysis tool. 
KBDex was developed to analyze knowledge-building discourse, and can support metrics of the three 
networks of degree centrality, betweeness centrality, and closeness centrality. Thus it can facilitate a visual 
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inspection of the semantic relationships, an analysis of pivotal points and phases, and trend analysis. We 
selected 10 keywords that were highly relevant to students’ inquiry topics from their online discourse for 
analysis. We argue that the keywords can represent the discourse content, so the closeness of keyword links 
and the number of keyword instances represent the density and diversity of discourse content, respectively. 


Table 1. Number of Different Categories of Contributions and Epidemic Complexity in Inquiry Threads 


Awareness of contributions Complementary contributions 
Creating shared Negotiating a fit steeds Regulating Synthesizing notes 
understanding : inquiry : 
: (high) uptake : (high) 
(medium) (eaedinrn) (medium) 

Total 318 70 119 62 22 38 

Mean 22.71 5 8.5 4.23 1.57 2.71 
SD 6.59 2.48 2.56 2.65 1.55 1.81 
1# 20 7 4 3 3 1 
2# 18 3 8 5 2 0 
3# 37 10 10 12 1 3 
4H 35 6 14 7 3 5 
S# 20 t 6 4 0 1 
6# 21 4 12 2. 0 3 
T# 20 3 8 3 4 2 
8# 16 3 8 2. 1 2. 
O# 29 7 8 6 0 7 
10# 23 6 8 4 0 4 
11# 23 7 8 4 0 4 
12# 16 1 8 2 3 2 
13# 23 3 11 3 4 2. 
14# 17 3 6 5 1 2 

The first 200 notes The first 400 notes All the 600 notes 


Figure 1. Snapshots of the Network of Students Over Time 


3.2 Changes of Collective Cognitive Responsibility and Idea Improvement 


To measure the extent of changes in collective cognitive responsibility and idea improvement, we first 
sequenced the notes in each of the 14 large inquiry threads, based on the time of the last modification, and 
then divided the notes into two phases, each with an approximately equivalent number of notes. Table 2 
shows that the frequency distributions for Phases 1 and 2 differed greatly. Generally, undergraduates in Phase 
2 engaged in more high-level discourse moves than those in Phase 1. For example, they engaged more in 
synthesizing notes that were critical for knowledge creation in Phase 2 than in Phase 1. 

Table 2 also shows that students in Phase 2 engaged more in discourse with higher explanatory power and 
quality, and in inquiry- and explanation-oriented discourse. For example, they produced many more 
“rise-above” notes than those in Phase |. These results indicate that the undergraduates gradually advanced 
their community ideas. 
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4. CONCLUSIONS 


In this study we investigated whether undergraduates were capable of take collective cognitive responsibility 
in the knowledge-building process. We found that they were able to progressively take collective 
responsibility to develop a knowledge-building discourse. However, a deliberate design that encourages their 
development is required to achieve these outcomes. The design of the knowledge-building environment 
involved three components: (1) the creation of an error-free collaborative environment; (2) periodic tasks to 
promote the development of collective cognitive development; and (3) knowledge-building talks to prompt 
collaborative reflection and the thoughtful use of the assessment data. This study demonstrates the potential 
of a knowledge-building environment that engages undergraduates in an examination-centered culture. The 
study had implications for teachers and researchers who aim to design technology-supported learning 
environments that can engage students who are generally unmotivated and disengaged. 


Table 2. Changes of Collective Responsibility and Community Ideas over Time 


Phase 1 Phase 2 
Total notes 162 156 
f % F %o 
Awareness of Creating shared 
contributions understanding (medium) 0 2086 a ae 
Negotiating a fit (high) 52 32.10 67 42.95 
Complementary Problem-centered idea 
contributions uptake (high) oy Eei22 a Pee 
Regulating inquiry (high) 13 8.02 9 5.77 
Synthesizing notes (high) 14 8.64 29 18.47 
Quality of Fact-seeking 3 1.85 0 0 
questions and Explanation-seeking 13 8.03 7 4.32 
ideas Simple claim 9 5.56 5 3.18 
Elaboration 49 30.25 36 23.08 
Explanation 72 44.44 77 49.36 
Rise-above 16 9.88 32 20.51 
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